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Ne  consider  separating  flow  control  into  a 
quasi-static  and  a  dynamic  part.  The  quasi¬ 
static  part  determines  allowable  transmission 
rates  for  each  session,  considering  priorities, 
fairness,  and  the  expected  level  of  congestion 
throughout  the  network.  The  dynamic  part  has 
the  function  of  admitting  or  rejecting  indi¬ 
vidual  messages  to  the  network  so  as  to  sat¬ 
isfy  the  above  allowable  rates  and  to  smooth 
out  the  fluctuations  in  arrivals  and  buffer 
occupancies.  Conventional  flow  control  strat¬ 
egies  are  primarily  dynamic  according  to  this 
division,  and  their  quasi-static  part  is  gen¬ 
erally  limited  to  rejecting  new  sessions  when 
the  system  is  heavily  loaded. 

As  an  example,  consider  a  network  with  end  to 
end  windowing  where  each  session  has  a  window 
of  w  packets.  If  there  are  m  sessions  each 
transmitting  packets  as  fast  as  possible,  then 
on  the  order  of  mw  packets  will  be  buffered 
in  the  network  (temporarily  ignoring  acknowl¬ 
edgement  times).  As  m  increases,  the  network 
will  eventually  become  congested.  Convention¬ 
al  strategies  can  sometimes  avoid  this  con¬ 
gestion  by  rejecting  new  sessions,  but  if  m 
increases  due  to  inactive  sessions  becoming 
more  active,  the  buffers  will  eventually  fill 
up.  The  problem  is  that  as  the  loading  in¬ 
creases,  delay  increases,  and  the  rate  of  each 
session  is  decreased,  but  not  quite  enough  to 
prevent  congestion.  What  is  needed  in  such  a 
situation  is  a  means  of  adapting  the  window 
sizes  to  varying  network  conditions.  Ne  show 
in  section  3  how  to  use  the  quasi-static  flow 
control  developed  in  section  2  to  adapt  window 
sizes  to  optimal  values  (according  to  a  flex¬ 
ible  criterion  of  optimality). 

H.  QUASI -STATIC  FLOW  CONTROL  AND  ROUTING 

Our  objective  in  this  section  is  to  determine 
an  optimal  set  of  input  rates  for  a  network 
of  given  topology  with  given  user  demands.  We 
take  the  viewpoint  of  a  supplier  of  network 
resources  who  can  lose  revenue  either  by  fail¬ 
ing  to  meet  user  demands  or  by  causing  long 
delays  and  lost  messages  due  to  congestion. 

Thus  for  each  session  using  the  network,  we 
create  a  cost  function,  e(r),  which  is  a  de¬ 
creasing  function  of  the  rate  r  allocated  to 
the  given  session  (see  Figure  1).  As  r  is  de¬ 
creased,  the  cost  in  user  dissatisfaction 
clearly  increases.  Ne  discuss  the  implica¬ 
tions  of  different  forms  of  this  function 
later,  but  for  the  time  being  simply  restrict 
it  to  be  twice  differentiable  and  convex 
(i.e. ,  the  second  derivative  is  non-negative). 


pected  queue  length  of  messages  waiting  to 
traverse  the  link  increases  and  the  danger  of 
congestion  increases;  g(F)  should  represent 
the  cost  of  this  congestion  danger.  It  seems 
appropriate  to  choose  g(F)  to  approach  •>  at 
the  maximum  link  flow  that  can  be  handled, 
given  the  number  of  buffers  in  the  node.  Typ¬ 
ically  this  maximum  F  will  be  somewhat  smaller 
than  the  capacity  of  the  link,  and  we  can  call 
it  the  effective  capacity,  C^,  of  the  link. 

A  reasonable  choice  for  g(F),  then,  in  keeping 
with  the  Kleinrock  independence  assumption  for 
network  queueing,  is 

8(F)  •  (1) 


Our  objective,  now,  is  to  fonn  an  aggregate 
cost  function  as  the  sum  of  the  individual 
session  cost  functions  and  link  cost  functions. 
We  then  choose  the  session  rates  and  network 
routes  to  minimize  the  aggregate  cost  func¬ 
tion.  In  the  remainder  of  this  section,  we 
set  up  the  minimization  problem  precisely, 
give  its  solution,  and  then  discuss  the  choice 
of  session  cost  functions.  Section  three 
shows  how  the  optimization  can  be  implemented 
in  a  distributed  way  and  relates  the  quasi¬ 
static  solution  to  dynamic  algorithms. 


Suppose  that  the  network  has  N  nodes  (switches) 
denoted  by  the  integers  1,,..,N,  and  for  nota- 
tional  simplicity,  assume  that  for  each  pair 
(i,j)  of  nodes,  there  is  at  most  one  user  ses¬ 
sion  originating  at  node  i  and  destined  for 


node  j.  Let  r^^  be  the  rate  (in  bits  per  sec¬ 
ond)  desired  by  the  user  for  this  session  and 
let  r^j  be  the  rate  allocated  by  the  network. 

Thus 


(2) 


If  there  is  no  session  from  i  to  j,  or  if  the 
session  is  currently  inactive,  we  take  ■  0. 


Let  the  network  have  L  directed  links  denoted 
1,...,L.  Each  link  goes  out  from  some  node  i 
into  some  node  j .  Let  0(i)  be  the  set  of  links 
going  out  from  node  i,  and  let  I(i)  be  the  set 
of  links  going  into  node  i.  A  full  duplex 
conaunication  channel  between  nodes  i  and  J  is 
regarded  as  two  links,  one  going  out  from  i 
and  into  j  and  the  other  going  out  from  j  and 
into  i. 


Similarly,  for  each  communication  link  of  the 
network,  wc  create  a  cost  function  g(f),  (see 
Figure  2)  which  is  an  increasing  function  of 
the  traffic  flow  F  on  that  link.  As  the  flow 
approaches  the  capacity  of  the  link  the  ex¬ 


Let  Fj^  be  the  user  traffic  flow  (in  bits/ sec.) 
on  link  I  and  let  f^  be  the  part  of  that 

traffic  belonging  to  sessions  with  destination 
node  j.  We  then  have  the  constraint  oqjuations: 


i 


J 
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N 


1 

j-1 

hi  •  ''1  ! 

(3) 

>  0  ;  l<t<L,  1<J<N 

C4) 

'li  *  ^  ^  ^11  * 

lel{i)  leO(i)  ” 


^  <  N;  i  J*  j  (5) 

Equation  (3)  states  that  the  total  user  traf¬ 
fic  is  simply  the  sum  of  the  traffics  to  all 
of  the  destinations.  Equation  (5)  states 
that  the  total  traffic  coming  into  node  i 
destined  for  node  j  (the  exogenous  traffic 
plus  the  traffic  passing  through  i  from 

other  nodes)  is  equal  to  the  total  traffic 
going  out.  If  f  .  was  taken  to  be  a  short 

term  average,  then  (5)  would  not  be  quite  cor¬ 
rect,  and  in  fact  the  left  side  minus  the 
right  side  would  represent  the  rate  of  buffer 
buildup  at  node  i  for  traffic  going  to  j. 

Out  viewpoint  here  is  somewhat  different,  and 
is  in  fact  the  essence  of  the  quasi -static 
approach.  We  are  allocating  session  rates, 
and  choosing  flows  which  would  be  feasible 
over  the  long  term  with  stationary  inputs  at 
the  allocated  rates.  Any  set  of  flows  sat¬ 
isfying  (3) - (5)  can  be  achieved  for  the  given 
input  rates  by  a  routing  policy  which,  for 
each  node  i  and  destination  j ,  routes  the 
traffic  to  j  out  of  i  on  outgoing  links  pro- 
.  portionally  to  the  terms  on  the  right  hand 
side  of  (5) ;  conversely  the  long  term  flows 
resulting  from  any  routing  policy  (given  that 
data  is  not  thrown  away  inside  the  network) 
will  satisfy  (3)-(5). 

;  The  objective  function  that  we  want  to  mini- 
\  mize  is  given  by 


g"  >  0,  e'  <  0,  eV,  >  0  for  1  <  £  <  L, 

*  ij  13  —  — 

1  <  i,j  <  N,  i  #  j.  Necessary  and  sufficient 

conditions  on  ?*,  ?*,  r*  to  minimize  (6)  subr 
ject  to  (2)-(S)  are  that  a  set  of  numbers 

11  1  N  exist  with  =  0,  1  1  i  1  N, 

such  that  a)  for  all  i,j,k, 

gi(Fi)  .  X^.  >  X. .  (7) 


for  £  e  I(k),  £  e  0(i),  with  equality 

if  tjj  >  0. 

and  b),  for  all  i,j  such  that  rf^  >  0, 
e'.(r*J  ♦  X. ,  /  =  0  for  0  <  r*..  <  rf. 


ij'  ij 


ij 


ij  ij 


<  0  for  T* .  »  r? . 

ij  ij 


>  0  for  r?.  =  0  (g) 

ij  ^ 


If  multiple  sessions  go  from  i  to  j,  then  r. . 

in  constraint  (S)  should  be  replaced  by  the 
sum  of  the  allocations  for  i,j  sessions,  and 
(8)  must  be  satisfied  individually  for  each 
session. 


We  can  interpret  Sj^CF]^)  as  the  incremental 

cost  of  traffic  on  link  £.  If  there  is  a  path 

carrying  traffic  with  destination  j  from  node 

i  to  node  j ,  then  X. .  is  the  incremental  cost 
ij 

of  .raffic  on  that  path.  Equation  (7)  then 
states  that  all  traffic  flows  on  paths  of  min¬ 
imum  incremental  cost.  If  one  views  S^CFp  as 

the  "length"  of  link  £,  then  (7)  states  that 
all  traffic  flows  by  shortest  routes.  This 
condition  is  well  known  when  the  rates  are 
fixed  and  one  is  optimizing  only  over  routing. 


|J(f".^  -  \  g,(F  )  ♦  I  I  (6) 

;  £-1  »  *  i-i  jii 

; 

I 

‘  where  g^^CFj^)  is  the  cost  of  congestion  with 

^  flow  on  link  £  and  oF 

restricting  the  session  i,j  to  the  rate  r^^. 

:  Analytically,  our  problem  is  to  minimize 

subject  to  the  linear  constraints  (2)- 
(S).  Applying  Kuhn-Tuckcr  theory,  we  arc  led 
to  the  following  necessary  and  sufficient 
conditions  for  minimizing  J.  [2,3]. 

j  Theorem  1;  Assume  that  and  e^^  have  first 

j  and  second  derivatives  satisfying  g*  >  0, 

I  ^ 


we  will  call  the  priority  function 

for  session  i,j.  It  is  the  incremental  gain 
for  additional  allocation  to  i,j.  Equation  (g) 

states  that  rjj  is  set  between  0  and  r^^  to 

make  this  incremental  gain  as  close  as  pos¬ 
sible  to  X^j  (i.e.,  equal  to  X^^  except  at 

the  end  points) . 

Note  that  the  optimality  conditions  (7)  and 
(8)  depend  only  on  the  incremental  link  costs 

gl  and  the  priority  functions  -e!,.  This 
a  Ij 

means  that  arbitrary  constants  could  be  added 
to  g|^  or  e^j  without  affecting  the  optimum. 

Note  also  that  the  optimum  point  is  indepen¬ 
dent  of  rjj  over  the  range  of  r^^  >  r^^.  This 
is  a  desirable  feature  for  a  flow  control 
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strategy,  preventing  users  who  are  being  ac¬ 
tively  flow  controlled  from  attempting  to  in¬ 
crease  their  share  of  the  resources  by  in¬ 
creasing  their  demands. 


ej^(r.j).  This  means  that  the  cost  function 
(7)  is  equal  to  *“■ 

taken  over  real  and  fictitious  links. 


The  maximum  average  network  loading  permitted 
by  the  flow  control  can  be  adjusted  by  scal¬ 
ing  the  priority  functions.  This  scaling 
factor  should  depend,  of  course,  on  how  ef¬ 
fective  the  dynamic  cwnponent  of  the  flow  con¬ 
trol  is  in  preventing  congestion  for  a  given 
short  term  average  load  level. 

Some  insight  into  the  choice  of  priority  func¬ 
tions  can  be  obtained  by  considering  the  pri¬ 
orities  of  the  form 


The  factor  a^^  in  (9)  should  be  taken  as  a 

measure  of  the  typical  rate  required  for  the 
session.  For  example,  two  sessions  between 
nodes  i  and  j  with  a  given  value  of  a^^j  are 

equivalent  to  a  single  session  with  twice  the 
above  value  for  a.^.  The  factor  b^^  is  more 

a  measure  of  the  importance  of  the  session. 
The  larger  b^.  is,  the  less  the  session  will 

be  cut  back  with  increasing  network  loading. 
Naturally,  if  b^^^  is  large  for  all  sessions, 

this  effect  disappears,  since  the  incremental 
costs  simply  increase  with  increasing  demands 
until  the  allocated  rates  are  feasible. 


The  minimization  of  this  cost  function  subject 
to  (2) -(S')  is  now  just  a  conventional  quasi¬ 
static  routing  problem.  In  simple  terms,  we 
have  replaced  the  question  of  how  much  traf¬ 
fic  to  allocate  to  session  i,j  with  the  equiv¬ 
alent  question  of  how  to  apportion  the  traf¬ 
fic  between  the  real  and  fictitious  links. 
There  are  a  variety  of  distributed  algorithms 
for  optimizing  quasi-static  routing  in  the 
literature  [4] -[7],  and  any  of  them  can  now  be 
used  to  jointly  optimize  quasi-static  flow 
control  and  routing. 

III.  DYNAMIC  QUASI-STATIC  FLOW  CONTROL 

The  major  difficulty  with  considering  flow 
control  in  terms  of  fictitious  links  in  a 
routing  problem  is  that  this  approach  is  not 
easily  combined  with  dynamic  flow  control.  To 
illustrate  both  this  problem  and  possible  al¬ 
ternative  approaches,  consider  the  use  of  end 
to  end  windowing  for  dynamic  flow  Control  [1] , 
[8].  In  this  situation,  the  allocated  traf¬ 
fic  rates  are  determined  by  the  window  sizes. 
Thus  the  quasi-static  part  of  the  flow  control 
is  to  choose  the  window  sizes  that  lead  to  the 
optimum  rate  allocation.  Unfortunately,  if  a 
single  window  size  is  changed  in  a  network, 
this  typically  changes  delays  throughout  the 
network,  and  thus  changes  the  allocated  rates 
for  all  the  sessions. 


In  considering  algorithms  to  solve  for  the 
optimum  rates  and  routes  of  (7)  and  (8),  we 
start  with  a  very  general  approach  that  re¬ 
duces  the  problem  to  a  quasi-static  routing 
problem.  For  eacn  session  l,j,  consider  a 
fictitious  communication  link  V  that  carries 

all  of  the  traffic,  rf^  -  r^^,  that  is  offered 

by  the  user  but  rejected  by  the  flow  control. 
Letting  0'(i)  be  the  outgoing  links  from  node 
i  including  these  fictitious  links,  the  flow 
constraint  equation  (5)  becomes: 


d 

ij 


*  I 

Jtel(i) 


Ij 


I 

tcO'(i) 


(S') 


Now  consider  imposing  a  cost  function  on  the 
■fictitious  link  V  that  carries  the  session 
;i,j  rejected  traffic  (see  fig.  5): 

gg, (fg,)  •  *ij^^ij  " 

i  i 

'since  r^j  -  F^,  is  Just  the  accepted  traffic 
.for  session  i,j,  8gi(^gi)  Is  ft's  same  as 

' .  - . - . -  1/ 


we  can  find  the  change  in  rates  for  a  given 
change  in  window  sizes  by  ignoring  flow  con¬ 
trol  for  the  moment  and  finding  the  relation 
between  the  expected  number  of  packets  out¬ 
standing  in  the  network  for  each  session  and 
the  rate  of  each  session,  assuming  constant 
routes.  Number  the  sessions  from  1  to  m,  let¬ 
ting  r^  be  the  rate  of  session  m  and  q^^^  be 

the  fraction  of  session  a  to  use  link  I  (note 
that  for  unifilar  routes,  q^^^  takes  on  only  0 

or  1  values).  Let  t,(F|^)  be  the  average  delay 
per  packet  on  link  I,  inclxuling  processing  and 
queueing  delays  at  the  input  to  link  f.  Let 
r  be  the  average  packet  length  (where  by 
packet  we  mean  the  transmission  unit  in  terms 
of  which  windows  are  defined).  Then  the  aver¬ 
age  number  of  packets  for  session  m  at  link  1 
is  given  by  r^  q^^  t^(Fj^)/r.  This  quantity, 

summed  over  I,  is  the  average  nuSber  of  pack¬ 
ets  traversing  the  network  at  a  given  instant. 
Let  be  the  average  delay  for  acknowledge- 

:ments  for  session  m.  We  assume  priority  for 
acknowledgement  traffic  so  that  is  indepen¬ 
dent  of  network  delays.  The  averaged  number 
^of  unacknowledged  packets  of  session  m  out  in_ 
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the  network  is  then 

•.  ■  r  1 1  •  “.J  (") 

Substituting  r^  <1^^^  into  (11^  and  dif¬ 

ferentiating,  we  get  the  matrix  equation 

P  -  T  +  RQMQ^  (12) 

where  "mk  is  r  3  T  is  a  diagonal  ma¬ 

trix  with  T^  -  q^j^  tj^(F^)  ^  a^.  R  is  a 

diagonal  matrix  with  R _  s  r  ,  Q  is  a  matrix 

mm  m 

with  elements  q^j^,  and  M  is  a  diagonal  matrix 
with  .  3  t^(F,)/3F^. 

Equation  (11)  relates  window  sizes  for  sessions 
to  rates  under  the  assumption  that  each  user 
transmits  as  fast  as  possible  subject  to  the 
window  limitation.  Golestaani  [2]  shows  that 
the  matrix  P  is  invertible,  which  means  that 
incremental  changes  in  window  sizes  lead  to 
uniquely  defined  changes  in  session  rates.  He 
shows,  moreover,  that  (11)  uniquely  specifies 
the  rates  in  terms  of  the  window  sizes  for 
given  increasing  functions  .  given  rout¬ 

ing  Q,  and  given  and  F.  Finally,  he  demon¬ 
strates  a  counter  example  to  this  uniqueness 
if  acknowledgements  are  not  sent  at  high 
priority. 

Now  consider  the  objective  function  (6)  ex-_^ 
pressed  as  a  function  of  the  session  rates  r 
and  the  routing  Q,  J*(r,Q).  It  is  easy  to 
calculate  3J*/3r  as  part  of  distributed  rout- 

t& 

ing  algorithms  [4] ;  it  is  simply  the  incre¬ 
mental  cost  of  traffic  on  the  routes  for  the 
session  minus  the  priority  function  for  the 
session.  It  is  reasonable  in  a  joint  flow  con¬ 
trol  and  routing  algorithm  to  increase  (de¬ 
crease)  the  window  size  for  session  m  when 
3J*/3r|^  is  negative  (positive).  Assume  in 

fact  that  one  changes  the  window  size  of  each 

session  by  an  incremental  amount 

Aw  ■  -  nr  3J*/3r  .  To  first  order,  the 
m  m  m 

change  in  J*  is  then 

AJ*  *  X  -  ^  Aw^  (IS) 

Using  (12),  this  becomes 

AJ*  •  -  f  (V.J*)(TR  ♦  RQMq’*^RJ(V*J*)‘’' 

jwhere  V*J*  is  the  gradient  of  J*  with  respect 
to  w.  Since  T,  M  and  R  are  positive  diagonal 
matrices,  it  is  easy  to  see  that  AJ*  is  neg- 

.  ""  r 


ative  if  J*  /  0,  and  this  approach  leads  to 
a  descent  algorithm. 

In  the  above,  we  have  shown  that  it  is  pos¬ 
sible  to  vary  window  sizes  in  accordance  with 
a  distributed  routing  algorithm  so  as  to  re¬ 
duce  the  quasi-static  objective  function.  For. 
simplicity,  a  number  of  details  have  been 
omitted,  such  as  the  maintenance  of  positive 
session  rates,  the  need  for  an  artiface  to 
achieve  incremental  variations  in  integer  win¬ 
dow  sizes,  and  the  combined  effect  of  routing 
and  window  variations.  Our  objective  has  not 
been  to  demonstrate  a  finished  algorithm,  but 
rather  to  point  the  way  to  a  wide  class  of 
algorithms  that  combine  a  quasi-static  method 
of  allocating  rates  with  a  dynamic  method  of 
smoothing  traffic. 


Cost  e(r)  of  Rate  Limitation  r  on  a  User 
Figure  1 


Congestion  Cost  of  Link  Flow  F 
Figure  2 


Relation  of  Session  Cost  e(r)  to 

Fictitious  Link  Cost  ^ 

_ _JPigurc  3 _ J 
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